Robust Multi-Modal Sensor Fusion: An Adversarial Approach
نویسندگان
چکیده
In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and industry. Multimodal entails the combination information from set different types sensors. Exploiting complementary sensors, we show that target detection classification problems can greatly benefit this approach result performance increase. To achieve gain, various sensors is shown to require some principled strategy ensure additional constructively used, positive impact on performance. We subsequently demonstrate viability proposed by weakening strong dependence functionality all hence introducing flexibility our solution lifting severe limitation unconstrained surveillance settings with potential environmental impact. Our data driven multimodal fusion, exploits selected optimal features an estimated latent space across modalities. This hidden learned via generative network conditioned individual sensor The space, as intrinsic structure, then exploited detecting damaged safeguarding fused system. Experimental results such automatic system robustness against noisy/damaged
منابع مشابه
A Model Based Approach to Statistical, Multi-Modal Sensor Fusion
We propose a framework for obtaining statistical inferences from multi-modal and multisensor data. In particular, we consider a military battlefield scene and address problems that arise in tactical decision-making while using a wide variety of sensors (an infrared camera, an acoustic sensor array, a human scout, and a seismic sensor array). Outputs of these sensors vary widely, from 2D images ...
متن کاملError-tolerant Multi-modal Sensor Fusion
Embedded sensor networks (ESNs) are one of the prime candidates for widely used ubiquitous computing systems that will bridge the gap between computing and physical worlds. One of the most important generic ESN tasks is multi-modal sensor fusion, where data from sensors of different modalities are combined in order to obtain better information mapping of the physical world. One of the key prere...
متن کاملRobust Multi-Sensor Fusion: A Decision-Theoretic Approach
Many tasks in active perception require that we be able to combine different information from a variety of sensors that relate to one or more features of the environment. Prior to combining these data, we must test our observations for consistency. The purpose of this paper is to examine sensor fusion problems for linear location data models using statistical decision theory (SDT). The contribu...
متن کاملA Message Passing Approach for Decision Fusion in Adversarial Multi-Sensor Networks
We consider a simple, yet widely studied, set-up in which a Fusion Center (FC) is asked to make a binary decision about a sequence of system states by relying on the possibly corrupted decisions provided by byzantine nodes, i.e. nodes which deliberately alter the result of the local decision to induce an error at the fusion center. When independent states are considered, the optimum fusion rule...
متن کاملNoncontact Sleep Study by Multi-Modal Sensor Fusion
Polysomnography (PSG) is considered as the gold standard for determining sleep stages, but due to the obtrusiveness of its sensor attachments, sleep stage classification algorithms using noninvasive sensors have been developed throughout the years. However, the previous studies have not yet been proven reliable. In addition, most of the products are designed for healthy customers rather than fo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Sensors Journal
سال: 2021
ISSN: ['1558-1748', '1530-437X']
DOI: https://doi.org/10.1109/jsen.2020.3018698